Generalizability Analysis for Educational Assessment
نویسندگان
چکیده
Evidence on the uncertainty attached to school and individual scores is required to avoid overinterpretation of scores. Generalizability analysis provides a standard error (SE) that is a suitable indicator of uncertainty; a value can be obtained for a design already executed or for a design being considered for possible use. Assessments depart from traditional measurements in ways that require extensions and modifications of generalizability analy-
منابع مشابه
Score Generalizability of Writing Assessment: the Effect of Rater’s Gender
The score reliability of language performance tests has attracted increasing interest. Classical Test Theory cannot examine multiple sources of measurement error. Generalizability theory extends Classical Test Theory to provide a practical framework to identify and estimate multiple factors contributing to the total variance of measurement. Generalizability theory by using analysis of variance ...
متن کاملGeneralizability Theory: An Analysis of Variance Approach to Measurement Problems in Educational Assessment
Of increasing interest to the educational assessment researchers is the reliability of scores obtained by various measurement procedures like tests, rating scales, surveys, and observation forms. Traditional methods of reliability based on Classical Test Theory (CTT) consider only one source of measurement errors. Generalizability Theory (GT) extends CTT by providing a flexible and practical fr...
متن کاملReliability of a viva assessment of clinical reasoning in an Australian pre-professional osteopathy program assessed using generalizability theory
Clinical reasoning is situation-dependent and case-specific; therefore, assessments incorporating different patient presentations are warranted. The present study aimed to determine the reliability of a multi-station case-based viva assessment of clinical reasoning in an Australian pre-registration osteopathy program using generalizability theory. Students (from years 4 and 5) and examiners wer...
متن کاملLost in Translation: Piloting a Novel Framework to Assess the Challenges in Translating Scientific Uncertainty From Empirical Findings to WHO Policy Statements
Background Calls for evidence-informed public health policy, with implicit promises of greater program effectiveness, have intensified recently. The methods to produce such policies are not self-evident, requiring a conciliation of values and norms between policy-makers and evidence producers. In particular, the translation of uncertainty from empirical research findings, particularly issues of...
متن کاملA report on the piloting of a novel computer-based medical case simulation for teaching and formative assessment of diagnostic laboratory testing
OBJECTIVES Insufficient attention has been given to how information from computer-based clinical case simulations is presented, collected, and scored. Research is needed on how best to design such simulations to acquire valid performance assessment data that can act as useful feedback for educational applications. This report describes a study of a new simulation format with design features aim...
متن کامل